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[57] ABSTRACT 

A method of automatically cptirnizing the controllable 
parameters related to producing printed material on a hard- 
copy output device is provided, along with a hardcopy 
output device configured for implementing this method. 
Users require different types of printed objects to have 
different characteristics. Specifically, business graphics need 
to be sharp and vivid, photographic images should look 
realistic, and text must be black, crisp and clear. By 
extracting, analyzing and conditioning data generated during 
a printing stream, the various regions of text, graphics and 
photographic images on a sheet are distinguished, 
characterized, and printed with a custom balancing of color 
pleasing to the human eye for each type of image printed. 

24 Claims, 6 Drawing Sheets 
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AUTOMATIC OPTIMIZATION OF 
HARDCOPY OUTPUT FOR ENHANCED 
APPEARANCE AND THROUGHPUT 

FIELD OF THE INVENTION 

The invention relates generally to a method of automati- 
cally optimizing the controllable parameters related to pro- 
ducing printed material on a hardcopy output device, and 
such a device implementing this method. 

BACKGROUND OF THE INVENTION 

The term "hardcopy output device" includes a variety of 
printers and plotters, including those using thermal Inkjet 
and electrophotographic technologies to apply an image to a 
hardcopy medium, such as paper, transparencies, foils, and 
the like. 

Most earlier hardcopy print devices have parameters that 
balance the competing requirements of throughput, typically 
measured in pages per minute, and the print quality of the 
hardcopy output These parameters also control the render- 
ing of the document into both the graphics format and 
hardware configuration of the particular device. However, 
the optimum settings for these parameters often varies for 
different types of documents. For example, documents with 
only black ink text have a different set of optimum param- 
eters than documents with colored images or business graph- 
ics. 

Most hardcopy print devices have a variety of mechanical 
print modes and rendering or halftoning options that affect 
the throughput and output quality. This is especially true for 
current color printers based on inkjet technology. These 
modes are often under the user's direct control, or they are 
set to default values calculated to provide only adequate 
quality output and throughput for the overall image. In this 
default mode, the earlier devices typically had parameters 
selected to optimize the most typical type of document they 
produced, while delivering only acceptable results when 
printing other types of documents. 

When under user control, in theory, the operator optimizes 
the printing parameters through trial and error. While an 
experienced operator may eventually determine the relation- 
ships between each printing parameter and its effects on the 
various types of outputs, this rarely happens. Most operators 
never master an understanding of the complex relationship 
between the numerous controllable printing parameters and 
the quality of the output Indeed, only experts experienced in 
the rendering and printing technology of a particular hard- 
copy device have a good chance of selecting the optimum 
printing parameters, but this task is quite labor intensive. 

Moreover, in the vast majority of earlier color matching 
techniques, it was impossible to vary the print mode settings 
on a page by page basis, or for different elements on a single 
page. Thus, the physical capabilities of hardcopy print 
devices are rarely exercised by the vast majority of opera- 
tors. As a result, often the printed output is of far lower 
quality, and with less throughput, then could have been 
achieved under optimal operating conditions. 

For example, consider a sheet containing text, a business 
chart, and a photographic image. When color matching was 
optimized for the photograph, the business chart suffered a 
loss of vivid color graphics. If instead, the color settings far 
the page were adjusted to deliver a brighter, more saturated 
graphic, then the photographic image lost its lifelike appear- 
ance. Thus, for the main stream operator using the earlier 
hardcopy devices, optimal hardcopy results were rarely if 
ever achieved. 
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SUMMARY OF THE INVENTION 

According to one aspect of the present invention, a 
method is provided of controlling the printing of a hardcopy 
using a hardcopy printing device having print characteris- 
tics. The method includes the steps of supplying a printing 
medium to a printing device and Instructing the printing 
device to print a selected image having plural elements on 
the medium. In a distinguishing step, each element is 

10 distinguished, and in response to this distinguishing step, an 
adjusting step adjusts the instructing step. In an illustrated 
embodiment, the image elements may be distinguished as 
being either textual, grayscale only, color graphic or photo- 
graphic images, with the instructing step being adjusted to 

15 generate a hardcopy output having crisp, clear text and 
grayscale images, sharp, vivid color graphics, and lifelike 
photographic images. 

According to another aspect of the present invention a 
hardcopy print device is provided for implementing such a 

20 method. In an illustrated embodiment, the hardcopy print 
device comprises an inkjet printer. 

An object of an aspect of the present invention is to 
provide a method and hardcopy print device that are easy to 
operate, and which use the full color mixing and matching 

25 capabilities of the print device to provide an optimal hard- 
copy output 

Another object of an aspect of the present invention is to 
provide a color hardcopy which is more vibrant, clear, and 
pleasing to the eye than that obtainable with earlier systems. 

30 An additional object of an aspect of the present invention 
is to provide a method and hardcopy print device that 
discriminates between various types of printed images, such 
as textual, grayscale only, color graphic and photographic 
images, and which selects black and color inks in mixtures 

35 to yield a preferred color reproduction which is pleasing to 
the eye, although not necessarily matching the color dis- 
played on an associated computer monitor. 
A further object of an aspect of the present invention is to 

^ provide an improved method of balancing the color require- 
ments for different components of a selected image on a 
component by component basis, using computer software 
with minimal operator input 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

FIG. 1 is a perspective view of one form of a hardcopy 
output device, specifically, an embodiment of an inkjet 
printer, of the present invention. 

FIG. 2 is a plan view of one form of a hardcopy output, 
30 having textual, grayscale only, color graphic and photo- 
graphic image components, produced according to the 
present invention. 

FIGS. 3Aand 3B, (collectively, "FIG. 3") comprise a flow 
diagram illustrating one form of the method of the present 
55 invention. 

FIG. 4 is a reproduction of a prior art computer monitor 
display used with earlier color matching systems. 

FIG. S is a reproduction of one form of a computer 
monitor display in accordance with the present invention. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

FIG. I illustrates an embodiment of a hardcopy printing 
65 device, here an inkjet printer 10, which may be used in an 
office or home environment for business reports, 
correspondence, desktop publishing, and the like. While it is 
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apparent that the printer components may vary from model 
to model, the typical inkjet printer 10 includes a chassis 12 
and a print medium handling system 14 for supplying a print 
medium, such as a sheet of paper 15 (FIG. 2), to the printer 
10. In addition to paper 15, the print medium may be any 
type of suitable sheet material, such as card-stock, 
transparencies, mylar, foils, and the like, but for 
convenience, the illustrated embodiment is described using 
paper as the print medium. The print medium handling 
system 14 includes a feed tray 16. an output tray 18, and a 
series of rollers (not shown) for delivering the sheets of 
paper from the feed tray 16 into position for receiving ink 
from an inkjet cartridge, such as a color ink cartridge 
20 — and/or a black ink cartridge 22. The illustrated color 
cartridge 20 is a tri-color pen, although in some embodi- 
ments (not shown), a group of discrete monochrome pens 
may be used, or a single monochrome black pen 22 may be 
used. 

The cartridges or pens 20, 22 are transported by a carriage 
24 which may be driven along a guide rod 26 by a conven- 
tional drive belt/pulley and motor arrangement (not shown). 
The pens 20, 22 may be conventional pens, which selec- 
tively deposit one or more ink droplets on a sheet of paper 
15 in accordance with instructions received via a conductor 
strip 28 from a printer controller 30 located within chassis 
12, for instance at the location shown in FIG. 1. The 
controller 30 generally receives instructions from a com- 
puter (not shown), such as a personal computer. A monitor 
(not shown) coupled to the computer may be used to display 
visual information to an operator, such as the printer status 
or a particular program being run on the computer. Personal 
computers, their input devices, such as a keyboard and/or a 
mouse device (not shown), and monitors are all well known 
to those skilled in the art 

FIG. 2 illustrates an example of a hardcopy output 40 
comprising the sheet medium, here paper 15, which has a 
selected image 42 printed thereon. The computer operator 
may select, create and/or edit the image 42 on the computer 
monitor prior to printing. The image 42 may include a 
plurality of components, elements or regions, such as: 
textual elements 44, 44' and 44" (referred to herein generally 
as "text 44" unless otherwise noted); a grayscale region, 
such as a business graphic bar chart 45, which has several 
data bars printed in different shades between black and 
white; a color business graphic region, such as a sectioned 
pie chart 46; and a photorealistic or photographic color 
component, such as a scenic image 48, Other elements may 
also benefit from being distinguished and processed, as 
described further below, such as line art used in engineering 
and architectural drawings. 

As mentioned in the Background portion above, in the 
past when a variety of different image types appeared on a 
single page, the earlier color adjustment schemes yielded 
unsatisfactory results. In earlier systems, if the hardcopy 
output 40 were skewed to provide accurate color for the 
photographic image 48, men the vivid color of the graphics 
46 would be washed out, whereas if the printer was skewed 
toward a saturated vivid color for the graphic, the photo- 
graphic image 48 would lose its lifelike appearance. 
Alternatively, these earlier print systems 40 allowed users to 
manually adjust the colors, as well as balance quality and 
throughput requirements, in an attempt to provide visually 
appealing images. In reality, very few people ever attained 
this level of sophistication or had the time to implement it on 
a regular basis. 

Another difficulty in manually adjusting the colors results 
from using a computer monitor as the composing medium. 
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Color is formed in a totally different manner on a computer 
screen than on a printed page. Computer monitors display 
colors that are combinations of red, green and blue light 
(RGB). The monitor displays the light rays of these primary 
5 colors which are then mixed by the human eye in an additive 
fashion and interpreted as a multicolor screen. These RGB 
colors are considered to be additive because their sum in 
balanced amounts is interpreted by the human eye as white 
light 

10 In contrast, a printer forms colors on a print medium via 
a "subtractive" mixing of cyan, magenta, yellow and black 
(CMYK). The cyan, magenta and yellow colors are consid- 
ered subtractive because they each absorb all light rays 
except those of the specific color produced. The letter "K" 

15 represents "true" black provided by pen 22, as opposed to a 
composite black formed by the sum of cyan, magenta and 
yellow in balanced amounts, such as by color pen 20, 
Another significant distinction between monitors and hard- 
copy outputs 40 is the manner in which the various grada- 

20 tions of colors are formed. A monitor provides a relative 
continuum of color levels using the RGB components (e.g. 
256 or more variations), whereas the hardcopy printer 10 
may have only discrete color control provided by selectively 
placing as few as three colors (cyan, magenta and yellow) on 

25 the sheet 15. 

In the past, color matching schemes attempted to produce 
a hardcopy output which had colors matching those appear- 
ing on the computer monitor. This "what you sec is what you 
get" ("WYSIWYG") operational philosophy provided hard- 

30 copy outputs which were not visually pleasing. Independent 
research contracted by the assignee of this patent application 
discovered two important concepts that challenged this 
traditional WYSIWYG assumptions. First, the hardcopy 
output 40, not the screen image, is considered to be the 

35 critical measurement of the users work. Second, while color 
matching between the printer and screen is important, users 
consistently preferred that the hardcopy 40 have brighter 
more vivid colors, rather than less vivid, perfectly- sere en- 
matched colors. Users also demand that graphics 46 be 

40 vibrant, and photographic images 48 be natural and lifelike, 
even when they both appear on the same page. 

To accommodate these competing desires, the printer 10 
incorporates a method of operating the controller 30 which 
is illustrated with reference to flow chart 50 in PEGS. 3A and 

45 3B (collectively, 'TIG. 3"). Generation of the hardcopy 
output 40 from a computer file or screen display typically 
involves several steps. These steps may occur in a printer 
driver (not shown) residing in the host computer, in the 
software contained in the printer 10, in the printer hardware 

so itself, or in any combination of these locations. For example, 
if the printer has the capability of rasterizing a page 
description, such as an Adobe Systems, Inc. PostScript® 
printer, or it has the capability of halftoning the rasterized 
page description, the printing process of flow chart 50 may 

55 occur partially or entirely within the printer 10. In any case, 
at one stage in the process, data defining the selected image 
42 is transmitted from the host computer to the printer 
hardware (e.g., the printer pens 20, 22, the drive mechanism 
for controlling carriage 24, and the paper handling system 

60 14) and the image 42 is printed on sheet 15. 

The types of data transmitted from the computer to the 
printer 10 typically varies depending upon the types of 
image components under consideration. For example, the 
textual components 44 may be transmitted as bit-mapped 

65 data or ASCH text characters, while the photographic image 
48 is typically transmitted as bit-mapped or pixel-mapped 
data. The graphs 45 and 46 are generally rectilinear objects, 
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and may be transmitted as bit-mapped data or as geometric 
shapes in a mathematical format with definitions for pattern, 
fill type, arcs, etc., together with boarder locations, 
thickness, titles and the like. 

Thus, in general the printed image components (textual 
44, grayscale 45, color graphic 46, or photographic 48) may 
distinguished based upon the data format received by the 
printer 10 from the computer. It is apparent that occasionally 
there will be exceptions, such as graphs 45, 46 which have 
been constructed by the user through bit-map or pixel-map 
techniques, which may then be interpreted as photographic 
images. Alternatively, each bit-map may be analyzed to 
determine its composition, such as by spatial frequency 
analysis and/or determination of the number of unique 
colors. However, the vast majority of people form business 
charts 45, 46 using graphics programs, as opposed to bit- 
map programs, so on a practical basis, any confusion of 
graphics as photographic images is expected to be minimal. 

Flow diagram 50 illustrates an embodiment of a method 
of the present invention using printer 10 in an environment 
provided by Apple Computer, Inc's QuickDraw® graphics 
language. The illustrated printer 10 is Hewlett-Packard 
Company's DeskWriter® 560C model inkjet printer, which 
has four stages for generating the hardcopy output 40. in the 
first stage, in a page generating step 52, a page description 
is generated, for example, by a user or a software application 
using a high level graphics language, such as the Post- 
Script® graphics language sold by Adobe Systems, Inc., or 
Apple Computer, Inc's QuickDraw® graphics primitives 
(shown in the illustrated embodiment). The generating step 
52 produces an output data stream signal 54 which may be 
accumulated as page description data 56. 

A page description signal 58, representative of the accu- 
mulated data 56, comprises an input to the second stage, a 
rasterizing page description step 60. This rasterizing step 60 
may be conducted in a variety of conventional manners 
known to those skilled in the art For example, the raster- 
izing step may include choosing a resolution which yields a 
selected optimum balance of throughput and print quality. 
Alternatively, these parameters may be supplied as user or 
printer inputs, as discussed further below. A data stream 
signal 62 output of the rasterizing step 60 may be accumu- 
lated as rasterized page image data 64. 

The rasterized data 64 may be supplied as a rasterized data 
signal 66 to the third stage for generating the hardcopy 
output 40, a halftoning step 68 for halftoning the page 
image. The halftoning step 68 may be accomplished in a 
variety of conventional manners known to those skilled in 
the art, including processes such as halftoning to different 
pixel depths, or those required to support different hardware 
printing modes. A data stream signal 70 output of the 
halftoning step 68 may be complied as halftonedpage image 
data 72. 

A halftoned data signal 74 represents the halftoned data 
72, and is supplied to the fourth stage, a final printing step 
75. This printing step 75 may be translated by a portion of 
controller 30 into instruction signals recognizable to the 
printer hardware to drive the paper handling system 14, the 
pen carriage 20, and the pens 20, 22 to selectively apply 
black and color inks to the print medium 15 to compose the 
selected image 42. XL is apparent to those skilled in the art 
that other hardcopy print devices may have more or less 
steps than the four stages 52, 60, 68 and 75 illustrated. The 
concepts illustrated by FIG. 3, and as described further 
below, may be modified accordingly to accommodate the 
varying number of printer steps involved for a specific 
hardcopy printing device. 
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In addition to the page description 52, other inputs may be 
provided to the illustrated embodiment of FIG. 3. While the 
rasterizing step 60 may select a resolution which balances 
throughput and print quality, these parameters may be sup- 
5 plied as other inputs 76, such as user or printer inputs 
supplied as an input signal 78. For example, a user may 
select the print quality as ''best," "normal" or "draft," with 
corresponding tradeoffs of lesser or greater throughputs, 
respectively. Another user input may be the type of print 
10 medium. Alternatively, these inputs 76 may be provided 
totally or in part by the computer, for instance, the type of 
print media 15 or pens 20, 22. 

In the illustrated embodiment of FIG. 3, the various types 
of data generated during the printing operation, here data 56, 
13 64 and 72, are extracted and conditioned, then injected into 
subsequent stages of the printing process, or used to alter the 
original data. Alternatively, this data may be extracted, 
modified, and then processed according to subsequent steps. 
In the illustrated embodiment for printer 10, there are three 
20 such data extraction and conditioning segments, which may 
be h'nked together as shown. While the illustrated embodi- 
ment interacts at each stage 52, 60, 68 and 75, interaction at 
less than all of the available stages may also be useful in 
some implementations. 
25 The first data extraction is the page description signal 58, 
which is supplied to a page statistics collecting and charac- 
terizing step 80. Id step 80, the page description data 56 is 
collected as statistics concerning the selected image 42. The 
statistics collected on the page description may be charac- 
30 terized by the type of geometric objects on the page, such as 
graphics 45, 46, and their attributes, such as size, border 
color, fill color, line thickness, and the like. Other statistics 
may include information on how text 44 is used on the page, 
as well as the text attributes, such as text size, color and 
35 spacing. It is often useful to gather other information, such 
as whether text is next to, or on top of colored regions. 

Additional statistics collected and characterized in step 80 
may include the presence of any scanned images 48, which 
^ often represent photographs. Other statistics regarding the 
selected image 42 may include recording which black 
objects touch color objects, which regions contain only 
black objects, and which regions contain a mixture of black 
and color objects that touch each other. This information 
45 may be useful far bleed control on CMYK printers that have 
negative interactions between the black (K) and color 
(CMY) inks. At this initial collecting step 80, statistics may 
also be gathered to define the bounding areas of regions 
having objects that would benefit from different post raster- 
J0 izing techniques. For instance, business charts 45, 46 may 
benefit from halftoning techniques differing from those used 
on the scanned photograph 48. 

Beyond characterizing certain features of the components 
44, 45, 46 and 48, step 80 may also characterizes image 42 
55 according to the subsequent steps which may be employed 
in certain regions. For instance, step 80 may characterize the 
type of post processing the photographic region 48 requires 
it* it is slightly out of focus and could benefit from sharp- 
ening. Also, a low resolution photograph may benefit from 
60 resolution enhancement or synthesis techniques. Color bal- 
ance and contrast are further examples of statistics which 
may be measured and characterized in step 80 for later 
correction, 

In step 80, it may also be useful in controlling subsequent 
65 image processing variables, to determine whether image 48 
is actually a scanned photograph or a synthetic computer 
generated image. The number and types of colors used on 
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the page may be counted in step 80 to take advantage of 
rendering the page at the lowest possible pixel depth for 
maximum throughput, or if only neutral (gray) colors 45 are 
detected, the page may be treated by printer 10 as a grayscale 
page rather than a color page to maximize both quality and 
throughput. 

When printing one or a sequence of plural hardcopy 
pages, step 80 may also collect statistics for each page as a 
whole, such as the number of elements, or the number of 
color elements on each page. Upon completion of all or 
portions of step 80. an output signal 82 carries the charac- 
terized data output of step 80 for accumulation as first 
characterization data 84. 

This first characterization data 84 is supplied by signal 86 
to a controlling rasterization parameters step 88. In the 
controlling step 88, the first characterization data 86 is used 
to generate a rasterization control signal 90, which is then 
supplied as an Input to The rasterizing page description step 
60. The first characterization data 86 may also be supplied 
to a modifying page description step 92. 

In the modifying step 92, the first characterization data 
signal 86 is used as an input to modify the page description 
for use on a specific type of hardcopy print device 10. Thus, 
the modifying step 92 may be different for an inkjet printer 
10 (FIG. 1) than that for an electrophotographic printer (not 
shown), for example, such as Hewlett Packard Company's 
LasesJet® printers, because these two devices have different 
print characteristics. The modifying step 92 provides an 
instruction signal 94 which may operate on the page descrip- 
tion data 56 to modify it in accordance with the type of 
printer in use. As with modifying step 92, controlling steps 
88, 104, and 120, modifying steps 108 and 124, and char- 
acterization steps 80. 96. and 112 are all tailored to the 
unique characteristics of each type of hardcopy print device. 

For instance, if black to color bleed control is to be 
handled on an object by object basis, then black objects that 
touch color, or fall within color regions, may have colors 
modified by step 92. In this case, step 92 insures the images 
are printed with the correct combination of CMYK to 
provide a good quality black without bleed into the "process 
black" of the (mixture of cyan, magenta and yellow) color 
regions. Another option is to use the black and color regions 
to control post processing of the black pixels in a later step 
to ensure process black is used where needed. 

In another example, step 92 may adjust the line widths to 
provide maximum quality and accuracy of reproduction by 
the hardcopy output device. For instance, on the color inkjet 
printer 10, color lines that are one pixel wide and designated 
to be produced with halftoned colors often must be thick- 
ened to a two-pixel width to ensure that enough halftoned 
pixels are printed to fully render the line in its true color. In 
contrast, black lines or lines produced with solid colors 
usually do not require thickening. 

In another example, step 92 could process photographic 
images with digital filters to sharpen the image, enhance 
edges, and remove noise from the image. 

The control step 88 produces the control signal 90 based 
upon the current page characterization. Thus, the rasterizing 
step 60 may be modified to provide different rasterizations 
according to which region, textual 44, graphic 45, 46, or 
photographic 48, is being rasterized by step 60. Thus, each 
of the regions 44-48 may be rasterized in a customized 
fashion, according to image type. 

The rasterization controlling step 88 may address other 
concerns. For example, if the page only contains scanned 
images 48 that are of relatively low resolution, the whole 
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page may be rasterized at the lower resolution to maximize 
throughput without reducing print quality. If the page con- 
tains only grayscale shades as in graphic 45, then the page 
may be rasterized on the order of eight bits per pixel, using 

5 a gray palette for maximum throughput and quality. 

As another example, the color objects 46, 48 may be 
tagged with color matching information (e.g. ColorSync® 
color matching produced by Apple Computer, Inc.), or if not 
so tagged, step 88 may perform this color matching opera- 

to tion before rasterization. Each color object 46, 48 may be 
color matched depending on what type of object it is. If thes e 
objects have already been tagged with color matching 
preferences, then these preferences may override automatic 
tagging commands of step 88, particularly if the commands 

15 were manually set, which ensures that the producer of the 
page description may control the type of color adjustment 
for each element on the page. 

The color matching schemes employed by step 88 typi- 
cally vary by object type. Photographic images 48 may be 

20 color matched with a human perceptual color matching 
scheme that ensures the colors match our memory colors 
(i.e. grass is the right shade of green and flesh colors come 
out correctly), provides good tone reproduction, and adjusts 
for colors mat are outside of the normal gamut of colors 

25 produced by printer 10 for a lifelike image. For small text 
and line art, step 88 may adjust the colors for greater 
intensity and/or changes in hue so the resulting image is 
sharp, vivid and clear. For business graphics and business 
charts, step 88 may match colors for a pleasing combination 

30 of vibrancy, while also limiting the colors to prevent over- 
saturation or bleeding through the page, depending upon the 
actual printing technology employed by printer 10. 
Step 88 may also operate to print objects with borders of 

35 a different intensity than the interior to provide both good 
edge definition and the required area saturation. This can be 
accomplished in QuickDraw® implementations, for 
instance, by modifying the border color in a different manner 
than the interior color. Alternatively, step 88 may divide a 

^ single object with a single color specification into two 
objects, then treat the border object as having one color, and 
the interior fill object as having a second color. 

In a second data extraction and conditioning segment, the 
rasterized image data 64 is extracted via signal 66 to provide 

45 an input to a collecting and enhancing step 96. In step 96, 
additional statistics regarding the rasterized page image, 
sometimes also referred to as a bitmap, are collected and 
used to enhance the page first characterization data 84, 
received via signal 86. Using the rasterized data of the first 

50 characterization 84, allows additional refinement in the 
characterization of image 42. The output of the enhancing 
step 96 is supplied as signal 98 to define a second charac- 
terized data set 100. 
The second characterized data set 100 is provided as 

55 signal 102 to a controlling halftoning parameters step 104. 
The output of step 104 is provided as a halftoning control 
signal 106 to the halftoning step 68. The signal 102 may be 
supplied as an input to an adjusting pixel image step 108 for 
post processing the rasterized page image data 64. In the 

60 adjusting step 108, the resulting pixel image signal 66 may 
be adjusted according to the specific attributes of (he printer 
10. As with the modifying step 92 above, the attributes of an 
inkjet printer 10 may be different from those of other types 
of hardcopy output devices, such as a plotter. For example, 

65 the resulting pixel image may be adjusted to include chang- 
ing the colors to account for inaccuracies in the color 
reproduction of printer 10. For example, different types of 
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ink formulations within the pens, particularly the color pen where the printer lays down only a percentage of the total 

20, may need adjustment to account for slight variations in ink dots available in a given print pass, and makes several 

hue, passes to complete a raster. Shingling hides most nozzle 

The output of the adjusting step 108 is provided as a pixel inconsistencies and reduces the ink bleed. Also, this mea- 

adjustment control signal 110, which adjusts the rasterized 5 suringof the amount of ink by step 112 may be used to warn 

image data 64 in this matter. Further color adjustments on when the ink cartridges 20, 22 are running low. 

the page may be accomplished by step 108. For instance, The third characterization data set 116 is supplied by 

photographic regions 48 may be further adjusted now, and signal 118 to a controlling of printing parameters step 120. 

large regions of high saturation may be adjusted to control Based upon this final characterization 116, controlling step 

the amount of ink subsequently printed at step 75. 10 120 provides a printing control signal 122 to the print step 

The post processing step 108 may include digitally fil- 75. The signal 118 may also be supplied to a processing 

tcring photographic regions 48 for smoothing, sharpening, halftoned data step 124. In the processing step 124 the 

resolution enhancement, and synthesis as needed. This fil- halftoned datamay be processed to prepare it for the specific 

tcring aspect of step 108 may only operate on photographic hardware of printer 10. It is apparent that this processing 

regions 48 which maximizes throughput and without modi- 13 step may vary depending upon the type of printing device 

tying other areas of the page, such as the text 44, that would used, such as an inkjet printer 10 which has the capability to 

not benefit from digital filtering. support » higher black resolution (600x300 DPT) than color 

Other examples of functions which may be performed by ^0x300 DPI), versus a hardcopy prindng device 

. — f f r- ' having the same resolution for both black and color. In this 

fce post piccrssuig acting step «8 include cparatag x * 

black aid color area, for bh*d «** .* - ta m ^'^^ ^ , Ksolution enlmIlcem(!llt „ 

previous steps at the object leveL Additionally, steps 104 or „. _ „ ~7f . - 

108 may smooth black data with a resolution enhancement * ot * « 5 «? • ™ZJ*£ 

algorifi^This step is particularly useful for printers like the Processing step 124 is supphed a S a J^s^con^l 

D«kWriter560cL!»vemec^^^ M ^nal U6 to process me hah^ne4 page irnage data 72 in 

black resolution (600x300 DPT) than color resolution (300x 0115 manner. 

300 DPI) m stc P areas mat arc V mc b kck may be printed with 

In step 104, the halftoning parameters are controlled settings to maxmuze throughput, while 

basedur^nmesecondcliaracterizeddata 100. For example, W»? ^ be printed witti settings to maxumze 

the halftoning step 68 may halftone the resulting resolution 30 ^^T^*^^A*^S^SFt 

specific image for a specific pixel depth. St£ 104 may ^lack text 44 then . A may 'be printed without shingling (best 

accomplish L by digititily halftoning *e 4c 42 using «), whJe color graphics 46 at the bottom of the page 

the appropriate halftoning technique for each region of the ™l require 50% srungling (best for color graphics) to putt 

pagc^For^tance, if users prefer business graphics 46 to be without noticeable defects With earlier prmting methods, 

Stoned with a different technique than scanned photo- 35 e W would ? avc to J° ^^^^f^ 

graphs 48, then step 104 n^y acconiplish uus distmction by slowed down the printer ^and possibly reduced the 

using the sUtisticTcollected from the page description and of the text at the top of the page, 

accumulated as data 84. The controlling step 120 may instruct printer 10 to hold 

In step 96 the rasterized image or bitmap data 64 may be onto a page before dropping it onto the previously printed 

scanned to collect a variety of additional statistics. For 40 P a S e based "P 0 * me 3111011111 ? f ink °° * e PJ 1 ™ ^ 

example, if black to color bleed control was not done on an Step 120 may select compression modes based on the type 

object by object basis, step 96 may scan the bitmap to * *** °° me W 10 maxiniize throughput and minimize 

separate me pure blackregions from the regions that contain 1™** dcfcrts b y me P™ ter stop ^ g P™** *» d 

a mixture of touching black and color pixels. This informa- then restarting, a phenomenon often caused by a lack of date 

tion may be used in step 104 to halftone the black that falls 45 in P™^ 3 ^.Jn another example of step 120, 

within the color regions as a process black (mixture of cyan, Mn&ng may be controlled on a page by page basis, or on 

magenta and yellow) and that which falls outside of the color a «gion basis for pages that benefit from different shingling 

regUs as a true black. In step 96, the pure black regions on different areas of the page, 

may also be separated from the color regions for special Thus, the illustrated embodiment of this method controls 

processing. For example, as described earlier, resolution so the printing process in an optimal fashion by collecting 

enhancement or smoothing may be applied in step 104 to the statistics at steps 80, 96 and 112 from at the respective stages 

black regions to enhance the edge definition. of print data 56, 64 and 72 on the type of document that is 

to a third data extraction and conditioning segment, a *»ing P riQtei ™* ^ 80 > 96 attd 112 use collected 

collecting and enhancing step 112 further enhances the data data to characterize the images appearing on the hardcopy 

describing the selected image 42 using the halftoned page 55 output 40 as textual images 44 grayscale images 45, color 

data 72, received via signal 74, in combination with the graphic irnages 46 or photographic images 48. At each stage, 

second characterization data 100, received via signal 102. additional information is collected, to refine the character- 

The output of enhancing step 112 is provided as signal 114 ^on of the document and reflect the page description 

to provide a third characterization data set 116. In step 112, transformation at each stage 52, 60 and 68 of the printing 

me density of pixels on the page may be measured and used 60 Process. Additional information is extracted from subse- 

to control printing characteristics to ensure the best quality qucnt stages and combined with the characterization from 

and highest throughput For instance, if the page has a large mc previous stages to enhance this refinement 

area of dense color pixels, step 112 may direct printing with Each of the characterized data sets 84, 100, 116 are linked 

a higher shingling mode to reduce color bleed, or the printer together so mat earlier characterizations are used in subse- 

may retain the following page longer before dropping it onto 65 quent characterization steps. Advantageously, the illustrated 

this dense page to assure adequate drying time. The term characterization of the hardcopy output 40 allows the indi- 

"shingling*' refers to a mode of operation for printer 10 vidual graphics elements 45, 46 and 48, as well as text 44, 
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to be controlled independently, For example, the colors of 
the business graphics 45, 46 may be processed differently 
from those of the scenic photographic image 48. Thus, bright 
vivid colors may be used for the graphics 45, 46, whereas 
more realistic subtler tones may be used for the photo- 
graphic image 48. 

Other data flow control schemes may also be imple- 
mented. For example, in step 96 of FIG. 3, the pure black 
regions may be separated from regions having touching 



ink. A grayscale version of the hardcopy output 40 may be 
particularly useful when transmitting the hardcopy image 
via facsimile for receipt on a black ink only facsimile 
machine. Other uses for a grayscale image include photo- 
copying on a black ink only photocopy machine, and print- 
ing quick proof or draft copies of color documents 

The steps and processes of printer 10 described may be 
re-ordered. Other modifications may be adapted depending 
upon the printer involved, for instance, color matching may 



black and color pixels. The blackink data may be transferred ™ occur at the object level and/or at the rasterized page image 

via signal 98 to the second characterized data 100, while the level Other steps may be added or modifications made to 

color and processed black ink data may be returned to the flowchart 50. For example, the statistics collection resulting 

main print stream via a return signal 66 for subsequent in characterizations 84, 100 and 116, may be fed back 

processing as a portion of rasterized page image data 64 at upstream to affect future output or to cause the process to 

step 68. Alternatively, the black ink data may be separated 15 restart with the new information about the current page. For 

and directed through steps 112 and 124 for addition to the instance, if at the end of the process, step 75, it is discovered 

halftoned page image data 72. that the page that contains too many printed dots, then the 

FIG. 4 illustrates a screen display 130 of a prior art printer, P^ess 50 may begin again with the image 42 being color 

particularly, the Hewlett Packard Company's DeskWriter "^J* * r ^"f ^ of *» f d m 

550C model inkjet printer using driver software version 2.0. 20 num f ber ^ printed dots. Thus, operation of a hardcopy 

mthepriorartsystemof screen 130, the color blending must F™** such " P™ ter ? accordance W1 th thepresent 

be separately selected, here illustrated as being selected as a invention enables the rendering and printing parameters to 

pattern 132 The color matching feature must also be bc "P*™* fOT cach *P e of document - * each 



selected, here illustrated as a standard selection 134. The 



component of a document such as those illustrated at 44-48, 



print cartridges in use arc also separately selected, here as 23 tlia ! a ™* * graphic el^ts nmy be mdividually 



35 



40 



black and color cartridges 135. An intensity selection 136 of 
the colors in another choice for the user to make. And finally, 
the operator must decide whether or not to minimize black 
and color bleed by either checking block 138 or leaving it 
blank as shown. 

FIG. 5 illustrates an embodiment of a monitor screen 
display 140 in accordance with the present invention. In 
particular, the screen display 140 shown appears on Hewlett 
Packard Company's DeskWriter® model 560C inkjet 
printer using driver software version 5.0, which has the 
configuration generally illustrated by printer 10. The illus- 
trated screen 140 includes an intensity selection 142, a 
halftoning selection 144, a bleed control selection 146 and 
a color matching selection 148. If customized color is 
desired, and an operator wishes to separately adjust these 
characteristics, a variety of selections (not shown) are 
available, some of which may be in the same manner as 
illustrated in the prior art systems. 

Advantageously, software embodying one form of the 45 
method of the present invention may be used to upgrade 
earlier printers originally sold without these capabilities. For 
example, the illustrated version 5.0 driver software may be 
used to upgrade the Hewlett Packard Company's 
DeskWriter® model 55 DC inkjet printer, described above ^ 
with respect to FIG. 4, 

One distinct advantage of the present invention is the 
availability of the "auto" selection for adjustments 142-148, 
as shown. This auto selection refers to the automatic color 
matching scheme illustrated by flow chart 50 which allows 55 
the various image regions 44 -48 to be distinguished and 
tailored for color matching as described above. The require- 
ments of the vast majority of users for clear vivid business 
graphics 46 with lifelike photographic images 48, may be 
easily obtained without requiring user involvement in setting go 
the various color composition factors. Thus, sharp vivid 
hardcopy outputs 40 are obtained with minimal user 
involvement. 

Moreover, in other screen displays (not shown), the 
system of the present invention also allows for the selection 65 
of printing colors in image 42 as a gray scale, a feature 
which was also available in earlier systems using only black 



optimized for each sheet printed. 
We claim: 

1. A method of controlling printing of a hardcopy using a 
hardcopy printing device having print characteristics, the 

30 method comprising the steps of: 

supplying a page of a printing medium to the hardcopy 

printing device; 
instructing the hardcopy printing device to print on the 
page a selected image having a combination of at least 
two elements comprising (a) textual material, (b) 
graphic images, or (c) photographic images; 
distinguishing each element of the selected image as 
being either (a) textual material, (b) a graphic image, or 
(c) a photographic image; 
collecting statistics for each distinguished element of the 

selected image; and 
in response to the distinguishing and collecting steps, 
adjusting the instructing step for each of the elements 
to be printed on the page to instruct the hardcopy 
printing device to (a) print any textual material accord- 
ing to a first set of parameters, (b) print any graphic 
image according to a second set of parameters, and (c) 
print any photographic image according to a third set of 
parameters. 

2. A method according to claim 1 wherein: 
the instructing step comprises plural printing stages; and 
the collecting and adjusting steps are repeated at each of 

the plural printing stages of the instructing step. 

3. A method according to claim 2 wherein the collecting 
and adjusting steps comprise collecting statistics based upon 
an output of any previous adjusting steps. 

4. A method according to claim 3 wherein at least one of 
the elements of the selected image may be a color image. 

5. A method according to claim 4 wherein: 
the hardcopy printing device comprises an inkjet printer 

having color printing capability; and 
the adjusting step comprises adjusting the color printing 
of the inkjet printer. 

6. A method according to claim 1 wherein: 
the instructing step comprises generating a data format 

representative of the selected image; and 
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the distinguishing step comprises distinguishing the data 16. A method according to claim 15, wherein: 

format for each element as either pixel maps of data, mc hardcopy printing device comprises an inkjet printer 

geometric data, or textual data. also haying co i or printing capability; and 

7. A method according to claim 1 wherein: ... 4 , . 

. - the adjusting step also comprises adjusting the color 

the instructing step comprises the step of generating a 5 J rf * 

page description of the selected image; and ^ ^ ^Lgto claim 1 farther including the 

the method further includes the step of ir^difytng the cc ^ ^ 

page description in accordance with the pnnt charac- c XctmgWtic S for each page. 

tensucs of the hardcopy printing device A hardcopy printing devtee for printing on a page of 

8. A method according to claim 7 wherein the modifying 1W A ?' ~ """""F* f "*» » s t™e 
step comprises the step of imposing a minimum line thick- f F°* a 5clcctcd ^ "f™* a combination of* 
nets on the page description least ^° elemeDts wmpnang (a) textual material, (b) 

9. A method according to claim 7 wherein: images, or (c) photographic images, the hardcopy 
the instructing step comprises the step of rasterizing the u device 

page description to provide a pixel image; and a chassis; 

the method further includes the step of adjusting the pixel a print medium handling system housed in the chassis for 

image in accordance with the print characteristics of the supplying the print medium page to a printing zone; 

hardcopy printing device to provide a resolution spe- a printhead that selectively deposits ink on the print 

cific image. 20 medium page in the printing zone in response to a 

10. A method according to claim 9 wherein the step of control signal- and 

adjusting me pixel image comprises the steps of adjusting acontraUc rwruch generates me control signal in response 

the colors in the pixel image. , 7 - . . ■ T. . . 

U. A method Wording u> claim 9 whereto te adjusting "> » *f »*• a page tacgn «»n 

step comprises the steps of: jj 8 , !electe<i ^ havi "S » combination of at least two 

r ^ , , . . . elements comprising (a) textual material, (b) graphic 

bailing two charactensucs of ^ hatdeopy pnnmig imge8)0r( ^ hoto ^ cimag(!s , wilhlh e d aUii,put 

device compiumg a tttougBpm characteristic »»a a - - ^ ^ 

are collected for each ele- 

pnnt quality characteristic, wherein an increase in the » ... 

Sroughput characteristic is achieved at a decline in the ™* of «« sclc ^ed image, with the data input having 

print quality characteristic, and an increase in the print 30 P°*">ns extracted and adjusted to characterize each of 

quality characteristic is achieved at a decline in the ^ elements to be printed on the page as either textual 

throughput characteristic; and material, a graphic image or a photographic image to 

selecting a resolution in response to the balancing step. enlace me selected image when^nted 

12. A method according to claim 9 wherein: »■ A hardcopy printing device according to claim 18 

iL 35 wherein the controller extracts and adjusts the portions of 

the instructing step comprises the step of ^dftoflmgAe characterize each of the plural element, to 

resolution specific image to provide halftoned print . *" r . 

data* and be printed on the page as either textual material, a graphic 

' . . , . ■ , j . L i *u image or a photographic image, 

me method further mcludes the step of 'l£™m ! «» 2 * A ha VpT printing device according to claim 18 

halftoned pnnt data in accordance with the print char- ^ , . . . *T . . ... ... , ... 

acteristo of the hardcopy printing device. 40 wherein the prmthead comprises aa irdget prtnthead, and the 

aAmeftc^accoidtogto clLiwherein: hardcopy pn*Ur,g device comprises ao irijet pmuer. 

, . . . 4 c 21. A hardcopy printing device according to claim 20 

the instructing step comprises the steps of: . 

generating a page description of the selected image wherein, 

using a high level graphics language; 45 said printhead comprises a black ink printhead; and 

rasterizing the page description for a selected resolution the inkjet printer further includes a second printhead 

to provide a pixel image; and comprising a color ink printhead. 

halftoning the resolution specific image for a selected 22. A method according to claim 1 wherein the distin- 

pixel depth to provide halftoned print data; and guishing step further includes the step of distinguishing a 

the method further includes the steps of modifying the so region of the selected image where two different plural 

generated page description, adjusting the rasterized elements touch one another. 

pixel image to provide an enhanced image, and pro- 23. A hardcopy printing device according to claim 20 

cessiag the halftoned print data, In accordance with the further comprising a printhead carriage system that propels 

print characteristics of the hardcopy printing device. th e printhead across the printing zone to selectively 

14. A method according to claim 1 wherein: 55 ink on the print medium page in response to a control 
the elements of the selected image comprise at least one signal. 

grayscale image; and 24. A hardcopy printing device according to claim 18 

the step of collecting statistics further comprises the step wherein the controller generates the control signal to instruct 

of collecting statistics for each grayscale image. ^ the hardcopy printing device to (a) print any textual material 

15. A method according to claim 14 wherein: according to a first set of parameters, (b) print any graphic 
the hardcopy printing device comprises an inkjet printer image according to a second set of parameters, and (c) print 

having monochrome printing capability; and any photographic image according to a third set of param- 

the adjusting step comprises adjusting the monochrome eters. 
printing of the inkjet printer for each element of the 

selected image. ***** 
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